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Abstract: The paper is devoted to the exponential stability of a class of neural networks with both 
discrete time-varying and distributed delays. In virtue of nonlinear measure, a delay- 
independent sufficient condition is derived for the existence, uniqueness and exponential 
stability of the equilibrium point. Since assumptions on boundedness, monotonicity and 
differentiability of activation functions and differentiability of time-varying transmission 
delay functions are avoided, the new stability criterion is an extension of some existing 
results. Moreover, an additional merit of the method is to provide the exponentially con- 
vergent velocity of the solutions. Finally, an example is provided to illustrate effectiveness 
of the method. 
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1 Introduction 


Neural networks have been widely investigated due to their potential applications such as 
associative memory, parallel computing, classification, pattern recognition and combinatorial 
optimization. Since the stability analysis of the neural networks is prerequisite in such applica- 
tions and time delays are unavoidably encountered in their implementation, it is necessary to 
study stability of neural networks with different types of delays. Up to now, there exist many 
excellent results on stability of neural networks with discrete time-varying and distributed de- 
lays by a linear matrix inequality approach!“ constructing Lyapunov functions!”!°l and the 
M-matrix theory!!4J, respectively. However, the boundedness of activation functions is usually 
imposed in the linear matrix inequality approach to guarantee the existence of equilibrium 
point of the neural networks. As we all know, the construction of a proper Lyapunov function 
becomes usually very skill, that is, there exists no general rule to guide how to construct a 
suitable Lyapunov function for a given system. Compared with the above two approaches, M- 
matrix approach requires neither the boundedness of activation functions nor the construction 
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of Lyapunov functions, but it doesn’t provide convergent velocity of the solutions. In some 
applications, it is usually necessary to estimate the convergent velocity of the solutions. 
Motivated by this, the aim of the paper is to investigate exponential stability of a class of 
neural networks with both discrete time-varying and distributed delays by nonlinear measure 
method!!2:13], Since the nonlinear measure is a nonlinear extension of matrix measure, our 
derived criterion is an essential characterization to stability of nonlinear systems with delays 
and it is worth mentioning that our method provides the exponentially convergent velocity of 
the solutions. Moreover, compared with some existing methods, our method does not require 
the differentiability of time-varying transmission delay functions, the symmetry of connection 
matrices and the differentiability, monotonicity and boundedness of activation functions, which 


means that our stability criterion is less conservative. 


2 Model description and assumptions 


We consider the following model of neural networks with discrete time-varying and dis- 
tributed delays 


du; t 
7 ) = -4a; (us()) [bi( (u;(t)) ey art u,;(t)) ) Lave u,(t — Tiz (t))) 
j=l 
n [e-e] 
2S f Kilt — a)hj(uj(s))ds + L] (1) 
got rae 
for i = 1,2,--- ,n. Here n > 2 is the number of neurons in the networks; u; is the state variable 


of the ith neuron, a; represents the amplification function, b; denotes the appropriately behaved 
function such that the solutions of (1) are bounded; fj, gj and hj are the activation functions; 
Tij (t) corresponds to the transmission delay along the axon of the jth unit from the ith unit 
and satisfies b = sup{7,;(t) : 1 <i, j <n,t © R} < œ; C = (cij)nxn, D = (dij)nxn and 
Q = (4ij)nxn are connection matrices; J; is the constant external input and K;; is the delay 
kernel. The initial condition associated with the model (1) satisfies 


ui = ġi € C((—00,0],R), i=1,2,--- ,n, 


where C((—oo, 0], R) denotes the set of all continuous functions from (—co, 0] to R. 
Throughout this paper, we make the following assumptions: 
(Hı): Each a; is continuous and satisfies 0 < à < a;(s) < 4, for alls ER; 
(H2): Each b; is continuous and there exists a constant Aà; > 0 such that 


(x — y) [bi(x) — bi(y)] >rA(e—-y)?, Yz,yER, 1=1,2,---,n; 


(H3): fj, gj and hj are Lipschitz continuous for j = 1,2,--- ,n. Conveniently, the following 
constants 
L(f;) = sup IA) = FW) L(9;)= sup llg;(2) - g) 
7" ayeRae#y Iz—yl} T eR ey lz — yll 


up T AAI e > yll 


? 
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are called minimal Lipschitz constants(MLC) of fj, gj and h; respectively; 
(H4): Kj; : (0, +00) — [0, +00) is a continuous function and satisfies 


co 
| e" Ki;(8)ds = piy(8), 
0 
where p;; is a continuous function on [0, ô) for some 6 > 0, and p;;(0) =1, i,j = 1,2, ,n. 


3 Preliminaries 


Let n-dimensional real vector space R” be endowed with 1-norm ||- ||; defined by 
n 
lzi = do lz:l, Y g = (T1, T2, Zn)? ER”, 
i=1 


where the superscript “T” denotes the transpose. Let (-,-) denote the inner product in R” 
and sign(x) = (sign(z1),sign(z2),--- ,sign(£n))T, the sign vector of x € R”, where sign(r) 
represents the sign function of r € R. It is obvious that ||z||1 = (x,siga(x)}) and ||z\]1 > 
(x,sign(y)) hold for all x, y € R”. 

Consider the following time-delayed system 


ould = F(u(t)) +G(u(s)), u(t)€ 9, t20, s€ (00,0), (2) 


Ue = PE C((—0o, 0], 9), 
where F and G are nonlinear operators from Q C R” into R”, uz € C((—o0,0], Q) is defined by 


u(s)=u(t+s), luello = sup flu(t+s)|hi, 
—oo<s<0 
T 
F(u(t)) = (Fi (u(t)), Falult)), -> , Falu(t))) , 
G(ut(s)) = (Gi(us(s)), Galue(8)) -- ,Gn(u(s)))’, Vt>0, 8 € (—00, 0]. 
Definition 17] Assume that 2 is an open subset of R” and F is a nonlinear operator 
from 2 into R”. The constant 


z (F(z) — F(y), sign(z — y)) 
Oe E lle — ylh 


is called the nonlinear measure of F on Q. 

Definition 2 Let u* be an equilibrium point of the system (2) and Q an open neighborhood 
of u*. Then u* is said to be exponentially stable on 2 if there exist two positive constants a 
and M such that the solution u of (2) initiated form any ¢ € C((—oo, 0], Q) satisfies 


lult) -ul < Me™ sup |[4(s)—2*|h, t20. 
—oo<s<0 


Moreover, if u* is exponentially stable on the whole space R”, the system (2) is said to be 
globally exponentially stable. 
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Lemma 1!7] If mo(F) < 0, then F : Q > R” is one-to-one mapping. In addition, if 
Q = R”, then F is a homeomorphism of R”. 
Paper [12] investigated the following discrete-delay differential system 


du(t) _ 
a) = F(u(t)) +G (u), (3) 


where F and G are mapping from Q of R” into R” and u, (t) is defined as 
Gi (ur (t)) = Gi( (u(t — Ta (t)), walt — Ti2(t)) > Un (t — Tin(t)))”), 


where G(u) = (G1 (u), G2(u), -+ ,Gn(u))”. 
Lemma 2l?) Let Q be a neighborhood of the equilibrium z* of the system (3). If the 
inequality 


ma-1(9) (FA) + La- (GA) < 0, (4) 
holds for some diagonal matrix A = diag(a1,a2,--- ,@n)’ with a; > 0, then z* is exponentially 
stable on 2, where L4-1(n) (GA) denotes MLC of nonlinear Lipschitz operator GA on its domain 
A~1(Q). Moreover, the exponential decay estimation of any solution x(t) of the system (2) 
initiated from zo € C([~-b, 0], Q) is determined by 


ila(t)—2*ll1<e*- sup |[zo(s)-a*I1, Vt>0, (5) 
= b<8<0 


where A is the unique positive solution of the equation 
O=A- min a; + m4-1(9)(FA) + La-r(qy(GA)-e. (6) 


Remark 1 By revising the proof of Lemma 2 in [12] we can easily conclude that if the 
inequality (4) holds under the assumptions (H})-(H4), the solution of the system (2) initi- 
ated from zo € C((—o0,0], Q) is exponentially stable and has the following exponential decay 


estimation 
læ(t) - z*lı <e7™: sup |{xo(s)—2" Ii, Vt>O0, (7) 
<s<0 


where is the unique positive solution of the equation (6). It should be mentioned that the 
equality 
t 
i Kij(t-—s)ds=1, Vt>0, (8) 
00 


was used in the revising proof. The equality (8) is easily derived from (H4). 


4 Main results 


In this section, we firstly prove that the system (1) enjoys a unique equilibrium point in Q. 
Let 2; denote the projection of the open subset Q on the i-th axis of R”. 

Theorem 1 Suppose that (H,)-(H4) hold and there exist positive real numbers d; (i = 
1,2,--- n) such that 


EIA Àj ~>{r WEY leas +1) OF ql + Lh; D dj “lassl} <1, (9) 


i=1 
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hold, where L(f;), L(g;) and L(h;) denote MLC of fj, gj and h; on 9;, respectively. Then for 
each set of external inputs J;, the model (1) has a unique equilibrium point u* in Q. 
Proof Define P = diag(di,d2,--- , dn) and an operator H : R” — R” by 


H;(u) = - [bi(ui) — So cis fi(us) — So disas(us) -$ ais / Ki; (t — s)hj(uj)ds + L], 
j=l j=l jar Y=% 


where 
u= (u1, Ue, “a tin) ER”, H(u) a (Hi (u), H2(u), oe ,Hn(u))”- 


From the assumption (H1) we easily derive that u* = (uł, u3,--- ,u%)7 is an equilibrium point 
of the model (1) if and only if H(u*) = 


For z, y € P(N), we have 


(P-'H(Px) - P~'H(Py), sign(x — y)) 


= J sign(z; — vif — d7’ (bi(diz:) — bi(diys)) + X- dy "cig (fj (dyxs) — fil(djys)) 
i=l j=1 


n 


+) a dij (g;(dj£j) — g;(djy;)) yS ‘ay f Kiz(t — s) (hj (djz;) — hj(djy,))as} 


j=l j=1 
n 
< raf - bane) = biliyo +) (Ie (dzs) = Ja(dsus) 
i=l j=l 


t 
+dij||95(dj25) — g;(djy;)| + leis Í Ki;(t — s)|hj(djx3) — hj (d;v;)lds) } 
=o 


n n 


-Yxa - vil +D D F [lel Lle — ysl + Idil L(G, ) lay — vil 


j=l t=1 


IA 
a 


a 


t 
Hasle; -wl | Kat- s)as] 


n 


= =) Alz: — vil >> ral leis L(f3) + dig (93) + lais |L(hs)}] |g — ysl 
i=l i=1 


=- fas = 2 ti leig|L(F;) + |dig|L(95) + laiz|L(h;)] } (20) 
j=l i=l 


The combination of (10) and (9) implies that mp-1(q)(P~'HP) < 0. In the light of Lemma 
1, P- HP is one-to-one. Consequently, there is only v € R” such that P~!'HP(v) = 0. The 
equilibrium point u* of the model (1) is unique in Q since P is non-singular. 

In what follows, we give an exponential stability criterion of the system (1) by Theorem 1 
and Lemma 2. For this, let F : R” — R” be given by 


F,(u) = —bi(ui) + X cig f(t) 


j=l 
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and G : R” — R” by 
n n t 
u) = Ddysgu) + Dray | Kij(t — s)h;(u;)ds + J. 
j=l j=l ~ 


Theorem 2 Suppose that (H,)-(H4) hold. Assume u* to be an equilibrium point of 
the model (1) and Q a neighborhood of u*. If there exist a set of positive real numbers 
d; (i = 1,2,- -- ,m) such that the condition (9) holds, then for each set of external input J,, the 
model (1) is exponentially stabile on Q. Particularly, if u(t) is the solution of the model (1) 
initiated from ¢ € C((—00, 0], Q), then 


iad |96)-whh, ve>o, (11) 


u(t) — u* |j < e77. — 
lute) hs Mini<i<nd; —oo<s< 


where o is the unique positive solution of the equation 


E . =i bo __ 
o mu Gj l+ke 0, (12) 
with 
cj = Àj -yY 7 lcis| 
and 


k= max {i5 [dig D(o4) + laslL(h)])} 


ma & 


Proof Let P = diag(di,d2,---,dn) and A = diag(c,',cz1,--- ,¢, 1). It immediately 
follows from (9) that 


n d; , 
For all z, y € A~'P-1(Q), 
(P~'F(PAz) — P~'F(PAy), sign(x — y)) 


< ran{- [bu( (et) = leew) + D el 5 *23) — Fyldye5*ys)I} 


lA 


vat = dics Alzi — yil + È lci; lL(f;)djc7 lz; — vil} 
i=l j=1 


=a og (su OF F eis) ley — wy = -le - vl» 


j=l 
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which implies that Se < —1. For all z, y € A~!P7!(Q), we have 


\|P“1G(PA)x — P~'G(PA)yl|, = Elar {$ dlodi z;) — g;(djc7 `v;)] 


2 j=l 


Daf Ki; (t — s) [hj (dye; ‘a;) — h;(djcz *y;)]ds }| 


j=l 
n n d; 
< D {P E E [leis L(o5) + lal L043)] }les — vil: 
j=1 j=1 * 
thus 
—_ -!I = 
Da-1 p-1(9)(P IGPA)< ps {c; 3 4 [dil Elg) + |qij|L(h il} =k. 

Consequently, from (9) we conclude that 


MA-1 p-1(q)(P7'FPA) + La-1p-1(q)(P~'GPA) 


JA 


-14 gos {6° g Tda) + ale} 


ax {=~ j + Dies Blew Ll) +d Flldizl L(g) + laig Lh; IN <o 
ADG Neasl (Es) 


From Remark 1 it is derived that the solution z(t) with the initial function z € C((—0o, 0], 9) 
of the time-delayed system 


tejen 


da(t 2 
O _ P(e(t)) + PGP (els), (13) 
satisfies 
\|x(t) — P-u*|| < e7. mp eeu u*|l1, Vt>0, 
—ow<s 


where o is the unique positive solution of the ciin (12). It should be noticed that x(t) = 
P-1u(t) is the solution of the system (13) initiated from z = P~'¢ € C((—00, 0], 2) whenever 
u(t) is a solution of the system (2) initiated form ¢ € C((—0o, 0], Q). Accordingly, we have 


llu(t)—u*] <e. sup |[¢(s)— url, Vt>0. 
—oo<s<0 


We conclude that the system (1) is exponentially stable on Q and its solutions exponentially 
decay by (11). 

Remark 2 Since the model (1) in [12} is a special case of the model (1), Theorem 2 is 
an extension of Theorem 3 in [12]. Behavior functions b and time-varying delays 7;;(t) are 
required to be differentiable in [9,14-20] and [21,22], respectively. However, the condition on 
their differentiability is removed in the paper. 

Remark 3 Papers [8,18,24,25] are devoted to the stability of neural networks where acti- 
vation functions are required to be bounded or monotonic. However, the paper makes no any 


bounded and monotonic assumptions for activation functions. 
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Remark 4 By stability criterion in [11] we can also derive that the model (1) is expo- 
nentially stable under the condition (7). Compared with our method, however, the flaw of the 
method in {11] is unable to provide the convergent velocity of the solutions. 

Example 1 Consider the following neural networks with discrete time-varying and dis- 
tributed delays 


= = —(2 + e" ®) [Bus (t) = ah (u(t) - io (ua(t) — T12(t)) 
t t 
-t l Kii(t — 8)hi(ui(s))ds — 5 J Kız(t — s)h2 (u2(s))as], 
dus(t) D 1 i. a4) 
TW = — (1 + u(t) [Tu - 5 fa(ualé) - za (u(t) -a 0)) 


-7 T Kalt — s)hı (u1 (s))ds — j l Ka(t— s)hz (u2(8))ds], 


where fi(r) = gi(r) = hi(r) = r — sinr, Kij(r) = e™ and 74;(t) = 2|sint| for r € R and 
i j=1,2. 


The nonnegative function 
ie 1 
pul) = | Kyd = 7 
0 1-8 


is continuous on [0, 1) for i, j = 1,2. b = sup{7;(¢),7,j = 1,2,t € R} = 2. It is easily verified 
that model (14) satisfies assumptions (H1)-(H4), where A; = Ag = 4 and L(fi) = 2 for i = 1,2. 
None of the stability criteria in [8,18,23-25] is applied since activation functions are neither 


bounded nor monotonic. However, we derive 


185 mas, {l Ws) ) Seles + Hay D> Ml + Lha) il} = max {5 . s5 <1, 


that is, condition (9) holds for dı = dz; = 1. According to Theorem 2, we conclude that the 
equilibrium point u* = (0,0)7 of the model (14) is globally exponentially stable and the solution 
satisfies the following exponential decay estimation 


|ur(t)| + lua(t)| < e7% een le(s), Vt29, 


where u(t) = (u: (t), ua(t))” is any solution of (14) initiated from  € C((—o0, 0], R?) and ø is 
the unique positive solution of the equation 


a 3 20 9, 


And a simulation of u(t) is showed in Figure 1. 
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Figure 1: The simulation for the solutions to the neural networks defined in Example 1 


5 Conclusions 


In this paper, exponential stability of the equilibrium point of a class of neural networks with 


both discrete time-varying and distributed delays has been investigated. A sufficient condition 
has been derived for the existence, uniqueness and exponential stability of the equilibrium point. 
Moreover, it is worth emphasizing that our method can provide the exponentially convergent 
velocity of the solutions. The proposed criterion is independent of the boundedness, differ- 
entiability and monotonicity of activation functions, the symmetry of connected matrices and 
the differentiability of time-varying transmission delay functions. It means that our criterion 
is less conservative than some existing ones. Finally, the simple example has demonstrated the 


effectiveness of our method. 
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